Papers with attribution techniques
Analyzing Memorization in Large Language Models through the Lens of Model Attribution (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing research has focused on extracting memorized content from LLMs or developing memorization metrics without exploring the underlying architectural factors that contribute to memorizing. |
| Approach: | They analyze how attention modules at different layers impact its memorization and generalization performance by using attribution techniques. |
| Outcome: | The proposed model can be used to mitigate memorization while keeping other components like layer normalization and MLP transformations intact. |
Seeing the Whole Elephant: A Benchmark for Failure Attribution in LLM-based Multi-Agent Systems (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks rely on partially observable traces that capture only agent outputs . lack of full execution traces obscures many failure causes, authors argue . |
| Approach: | They propose a benchmark that allows attribution under full execution observability . they find full traces improve attribution accuracy by up to 76.5% over a partial-observation counterpart . |
| Outcome: | The proposed benchmark improves attribution accuracy by up to 76.5% over a partial-observation counterpart. |